Adaptive Memory Based Regression Methods
نویسندگان
چکیده
The task of approximating a non linear mapping using a limited number of observations, asks the data analyst to make several choices involving the set of relevant variables and observations, the learning algorithm, and the validation protocol. In the case of models which are linear in the parameters (e.g. polynomials), statistical theory and economical cross-validat ion met hods provide fast and effective ways to support these choices. However, when pure approximation performance is at stake, a unique linear structure to cover the whole range of data, is often far from optimal. Memory-based methods in contrast are well known to considerably improve the approximation performance, since all the regression analysis is done locally and repeated for each new query. In this paper, we discuss the use of these cross-validation procedures for selecting the features, the neighbors and the polynomial degree for each prediction. The possible automation of these selections on a query basis provides memory-based methods (generally not used in such a flexible way) with a larger degree of adaptivity. Experimental results in time series prediction are presented. I .a. where L(y, f-(x, a)) is the 1oss function in a point x of the KeywordsSupervised learning, prediction.
منابع مشابه
Adaptive Steffensen-like Methods with Memory for Solving Nonlinear Equations with the Highest Possible Efficiency Indices
The primary goal of this work is to introduce two adaptive Steffensen-like methods with memory of the highest efficiency indices. In the existing methods, to improve the convergence order applied to memory concept, the focus has only been on the current and previous iteration. However, it is possible to improve the accelerators. Therefore, we achieve superior convergence orders and obtain as hi...
متن کاملAdaptive Tunable Vibration Absorber using Shape Memory Alloy
This study presents a new approach to control the nonlinear dynamics of an adaptive absorber using shape memory alloy (SMA) element. Shape memory alloys are classified as smart materials that can remember their original shape after deformation. Stress and temperature-induced phase transformations are two typical behaviors of shape memory alloys. Changing the stiffness associated with phase tran...
متن کاملRelevance vector machine and multivariate adaptive regression spline for modelling ultimate capacity of pile foundation
This study examines the capability of the Relevance Vector Machine (RVM) and Multivariate Adaptive Regression Spline (MARS) for prediction of ultimate capacity of driven piles and drilled shafts. RVM is a sparse method for training generalized linear models, while MARS technique is basically an adaptive piece-wise regression approach. In this paper, pile capacity prediction models are developed...
متن کاملStructure of an Adaptive with Memory Method with Efficiency Index 2
The current research develops derivative-free family with memory methods with 100% improvement in the order of convergence. They have three parameters. The parameters are approximated and increase the convergence order from 4 to 6, 7, 7.5 and 8, respectively. Additionally, the new self-accelerating parameters are constructed by a new way. They have the properties of simple structures and they a...
متن کاملA limited memory adaptive trust-region approach for large-scale unconstrained optimization
This study concerns with a trust-region-based method for solving unconstrained optimization problems. The approach takes the advantages of the compact limited memory BFGS updating formula together with an appropriate adaptive radius strategy. In our approach, the adaptive technique leads us to decrease the number of subproblems solving, while utilizing the structure of limited memory quasi-Newt...
متن کاملPredicting Flow Number of Asphalt Mixtures Based on the Marshall Mix design Parameters Using Multivariate Adaptive Regression Spline (MARS)
Rutting is one of the major distresses in the flexible pavements, which is heavily influenced by the asphalt mixtures properties at high temperatures. There are several methods for the characterization of the rutting resistance of asphalt mixtures. Flow number is one of the most important parameters that can be used for the evaluation of rutting. The flow number is measured by the dynamic creep...
متن کامل